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ABSTRACT 



An interactive entertainment system enables presentation of 
supplemental interactive content along side traditional 
broadcast video prams, such as television shows and movies. 
The programs are broadcast in a conventional manner. The 
supplemental content is supplied as part of the same pro- 
gram signal over the broadcast network, or separately over 
another distribution network. A viewer computing unit is 
located at the viewer's home to present the program and 
supplemental content to a viewer. When the viewer tunes to 
a particular channel, the viewer computing unit consults an 
electronic programming guide (EPG) to determine if the 
present program carried on the channel is interactive. If it is, 
the viewer computing unit launches a browser. The browser 
uses a target specification stored in the EPG to activate a 
target resource containing the supplemental content for 
enhancing the broadcast program. The target resource con- 
tains display layout instructions prescribing how the supple- 
mental content and the video content program are to appear 
in relation to one another when displayed. When the data 
from the target resource is downloaded, the viewer comput- 
ing unit is responsive to the layout instructions obtained 
from the target resource to display the supplemental content 
concurrently with the video content program. Embedding 
the layout instructions in the supplemental content advan- 
tageously places control of the presentation to the content 
developers. The developers are free to arrange the data and 
video in any manner they choose. 

16 Claims, 11 Drawing Sheets 
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INTERACTIVE ENTERTAINMENT SYSTEM together in a complex, non-sequential web of associations 

FOR PRESENTING SUPPLEMENTAL Ibat permit a user to browse through related topics, regard- 

INTERACTTVE CONTENT TOGETHER less of the presented order of the topics. Hypermedia content 

WITH CONTINUOUS VIDEO PROGRAMS is widely used for navigation and information dissemination 

5 on the "World-Wide Web" (WWW or Web) of the Internet. 

TECHNICAL FIELD An application program referred to as a "Web browser" is 

normally used to retrieve and render hypermedia content 

This invention relates to interactive entertainment from mc ^rwW 

systems, such as interactive television or interactive com- ^ . , . . r • . . - 

' • ' , . w , , ... • Despite the development of interactive entertainment in 

puting network systems. More particularly, this invention in . r \. . « ... . .... 

r , & , , r »• i . i ■ » 10 the computer sector, there has been little activity spilling 

relates to methods for presenting supplemental interactive .... . j-.- i, i • ■ u tl n/ • 

r . . ? -j * over mto the traditional television world. The TV environ - 

content in conjunction with contmuous video programs to . . . , , . 

, , J . A . . . . . iL r . ment poses a problem in that the programs are typically 

enable viewer interactivity with the otherwise non- . * if j . r j . * 

i ter c v video ro rams delivered as a broadcast of a continuous data stream, which 

in erac ve vi eo programs. inherently does not support interactive control. Interlacing 

BACKGROUND OF THE INVENTION 15 mtcrac ^ vc content presents a difficult design issue. 

One proposed solution is a technology referred to as 

Video content programs, such as TV shows and pay-per- "Intercast technology" which is available from the Intercast 
view movies, are delivered to a viewer as a continuous data Industry Group, a consortium of leading television 
stream. Today, programs are most commonly distributed networks, program hardware vendors, and software vendors, 
using a wireless broadcast system, or a cable system. In the 20 Intercast technology presents both television programs 
first instance, the programs are broadcast over a wireless anc j Internet data together on the same television or corn- 
network and received at individual homes through an p U ter monitor, but with separate and predefined panes, 
antenna or satellite dish. In the latter case, the programs are FIG t shows a screen 14 (television or computer monitor) 
transmitted over cable to set-top boxes resident in the which mustrates the Intercast technology. The screen 14 is 
viewers' homes. 25 fo yidf > d mt0 panes ^ as represented by panes 16-18. Pane 16 

In broadcast distribution systems, there is no opportunity contains the television program resulting from the video 
for interactive control of the content by the viewer. The data. Pane 17 contains a hypermedia document, such as a 
viewer simply has an option to watch the program, change Web page, that is provided by the Internet data. A third pane 
to a different program, or turn off the television. However, 18 can be used to show additional data, such as advertise- 
as consumers have learned from playing video games on 30 ments or the like. 

their televisions, non-interactive viewing is not nearly as fun Th c internet data is combined with the video data of the 

or sensory rich as interactive entertainment. television program to form a single signal that is broadcast 

To enhance the traditional way of viewing television, to the viewer. The Internet data is transmitted during the 

there has been some effort toward the production of inter- ^ vertical blank interval (VBI) between successive frames of 

active programming content. As presently contemplated, the video data. The Internet data and video data are separated 

additional interactive content is created to enhance the at the viewer's computer and presented simultaneously 

existing traditional program. This supplemental content is within their respective panes. 

played along with the continuous video stream to enable jh e drawback with the Intercast technology is that it 

viewers to interact with the program in a more involved 4Q rigidly adheres to the paned presentation. The television 

manner than simply watching it. The supplemental content panc \§ j s a self-contained pane which is dedicated to 

might, for example, ask the viewer questions about the showing only the video program, and the Web pane 17 is a 

episode, or play games with the viewer that relate to the separately self-contained pane which is reserved exclusively 

show, or describe behind-the-scenes aspects of making the f or \y e b content. Content providers who develop the Internet 

program. However, there remains a significant hurdle con- ^ data nave no control over how the television program and 

cerning how to create and distribute interactive programs. interactive supplemental content is presented to the viewer. 

Apart from the TV environment, however, computer users They can simply control how the data is presented within its 

are familiar with interactive content on their computers. own box 17. Accordingly, the content providers are signifi- 

Many users own interactive multimedia CD-ROM applica- cantly limited in what they can create in the way of a full 

tions that combine video, audio, pictures, text, and other 50 interactive media event. 

content into a rich and responsive presentation. Familiar The inventors have developed a better way of creating and 

examples of interactive computer applications include distributing interactive programming that frees the content 

games (e.g., Myst from Broderbund), educational programs providers of these restrictions, 
(e.g., Reader Rabbit series from the Learning Company or 

Magic Schoolbus series from Microsoft), and home enter- ss SUMMARY OF THE INVENTION 

tainment (e.g., Encarta from Microsoft). This invention concerns an interactive entertainment sys- 

Interactive content is also available from online services tem for supplying interactive supplemental content along 

over a public network. Most notably, the Internet is emerg- with continuous video content programs to viewers. The 

ing as a means for supplying video, sound, pictures, text, and programs are supplied from a program provider, such as a 

other multimedia rich resources to a user's computer. $0 cable headend or a broadcast station, over a distribution 

Through the Internet, users can access a wide variety of network to a viewer computing unit. The programs are 

resources that are maintained on computers located around continuous, non-interactive data streams, such as television 

the world. shows, movies, or other video content. 

Resources available on the Internet are most commonly The viewer computing unit is implemented as a 

presented as hypertext. "Hypertext," also referred to as 65 television^ television/set-top box unit, a personal computer, 

"hypermedia," is a metaphor for presenting information in or the like. It has a processor and memory. An electronic 

which text, images, sounds, and actions become linked programming guide (EPG) is stored in the memory and 
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executable on the processor to organize programming infor- FIG. 5 is a block diagram of a viewer computing unit 

mation that is descriptive of the video content programs. The according to an aspect of this invention. 

EPG maintains a data field that indicates whether the video FIGS 6 and 7 show a flow chart for operating an 

content program is interactive. The EPG data field contains mteraclive entertainment system. 

a pointer, universal resource locator, or other target spcci- 5 mjn „ „ , 

ficaiion to the target resource that supports the interactive FIG - 8fl "? c are a senes of exemplary screen illustrations 

content and correlates this data field with the particular showiD S **P^Y layouts of the video program and 

program that the supplemental content is designed to me supplemental content. 

enhance. Accordingly, if a target resource is listed in con- FIG. 9 is a flow chart of a method for authoring an 

junction with a particular program, the program is recog- J0 interactive entertainment program, 
nized as being interactive. The supplemental content can be 

developed and provided by the same provider that distrib- DETAILED DESCRIPTION OF THE 

utes the video content program, or by an independent service PREFERRED EMBODIMENT 
provider. 

When the viewer tunes to a particular channel, the viewer mG - 2 shows m interactive entertainment system 20 

computing unit consults the EPG to determine if the present 15 implemented as an interactive television (ITV) system, 

program is interactive. If it is, the viewer computing unit System 20 includes a centralized headend 22 which is 

launches an interactive support module, such as an Internet configured to provide continuous video content programs to 

browser. This browser is kept in memory and is dynamically multiple subscribers. These programs might include tradi- 

loadable for execution on the processor when the viewer tional broadcast TV shows, movies, games, and the like. The 

tunes to a channel carrying a video content program that the 20 programs are transmitted as a continuous data stream, which 

EPG identifies as interactive. The viewer computing unit is non- interactive in itself. 

also depicts a small icon or other indicia to alert the viewer Eacn subscriber has a viewer computing unit 24. In the 

that the program is interactive. The viewer can click on or illustrated implementation, the viewer computing unit is 

otherwise activate the icon to enter the interactive mode and em5odied as a box (STB) 26 coupled t0 a television 

display the supplemental content As an alterna ive the 25 ^ 2g ^ SJB u rcccivei / di g ital vidco signa i s from 

supplemental content can be automatically displayed in > J afld ms ^ Qn 

response to launching the Internet browser. {hcTV 28 . ^ STB 26 i, contro ^| by thc viewe P r ^ rough 

-Hie Internet browser uses the target specification in the use of a , , ocated Qn [{s fa Qf a hafld held 

EPG to start the target resource The target resource contains rcmQtc ^ 3Q Instead of ft K STB howcvCTt 

the supplemental content to enhance the television program. 30 a viewer computing unit be incorporated in the TV itself. 

The supplemental content might be, for example questions Jn to televisi the vicwer computing unit might 

about the program, games, trivia information, facts about the be im i emented ^ other ly ^ s of visua i display unitS) 

actors and producers, information on other episodes, sucfa ag a uter monitoI . as ^ descri bed below with 

advertisements, a listing of products or memorabilia about t tQ ^ nG 4 implememation . 

the program, and so on. The supplemental content and 35 ^ , . . „ 

program can be transmitted together as a single signal, , Each viewer computing unit 24 is configured to run an 

which is separated at the viewer computing unit, or sepa- electronic program guide (EP). The EPG provides an 

rately over two channels or two different networks. on-screen listing of various programs or program titles The 

' ' , , ■ j * i i * - * listing is organized in a predetermined arrangement that is 

The target resource also contains display layout instruc- _° , * , t1 .f ™ ™~ • .7 i , A 

fe _ . . . . 4 i ; . j .l. displayed on the television. The EPG might also include 

tions prescribing how the supplemental content and the 40 * J , . . c t . • , j- , 

. . H A t 6 / y i *■ » other program descriptive information, including whether 

video content program are to appear in relation to one r & . . , T , . . , ' & 

i i • i j 4 . 4 , . . , 17U the program is provided in closed caption or stereo, 
another when displayed on the television or monitor. When y 6 v K 
the data from the target resource is downloaded to the viewer Headend 22 is interconnected to the subscribers via a 
computing unit, the processor is responsive to the layout distribution structure or network 32. The distribution struc- 
instrucuons obtained from the target resource to display the 45 tare 32 be implemented in different ways. One imple- 
supplemental content concurrently with the video content mentation is a multi-tier network which includes a high- 
program. Embedding the layout instructions in the supple- speed, high-bandwidth fiber optic cable network between 
mental content advantageously returns control of the pre- lh e headend and regional distribution nodes (not shown), 
sentation to the content developers. The developers can now and conventional home entry lines, such as twisted-pair lines 
arrange the data and video in any manner they choose. The 50 or w™* 1 cable > between the distribution nodes and viewer 
developers are not restricted to specific fixed panes, as in the computing units. Other implementations include satellite 
prior art. communications (e.g., DSS technologies), RF 

communication, or other wireless technologies. Moreover, 

BRIEF DESCRIPTION OF THE DRAWINGS the network can be constructed using a combination of 

FIG. 1 is an illustration of a screen showing a paned 55 wireless and wire-based technologies, 

presentation format for presenting television programs and [ n the illustrated implementation, the network 32 provides 

Internet data according to prior art Intercast technology. both thc pipeline for distribution of programs from the 

FIG. 2 is a diagrammatic illustration of an interactive headend to the subscriber, as well as a back channel which 

entertainment system according to one implementation. The enables communication from the subscriber to the headend. 

FIG. 2 implementation is representative of an interactive TV 60 The back channel permits the viewer to send requests and 

system. instructions to the headend to facilitate interactive control. 

FIG. 3 is a simplified example of data fields in a data Headend 22 provides video content programs to the 

structure maintained by an electronic programming guide. viewer computing unit 24. The programs are embodied as 

FIG. 4 is a diagrammatic illustration of an interactive video data streams that are transmitted from headend 22 

entertainment system according to a second implementation, 65 over distribution structure 32 to the viewer computing unit, 

which is representative of an interactive integrated PC-TV The headend maintains a database of programs 40 that can 

system. be served by a continuous media server 42 to individual 
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viewers in an on-demand mode. The headend can also audio, the scheduled lime of the program, the network name, 

retransmit to its subscribers broadcast video signals that it and description text. Each program record in the data 

receives from another source, such as a satellite feed or structure 48 also holds pointers to storage locations within 

another cable system. The video data streams are sent to the the continuous media server 42 which hold the video data 

viewer computing units in digital or analog format. s streams of the programs corresponding to the program 

An EPG server 44 is provided at headend 22 to serve the records, 
programming information needed by the EPG at the viewer The data structure 48 includes a data field 58 for holding 
computing unit 24. The EPG server 44 is implemented as a target specifications which reference target resources sup- 
structured query language (SQL) database 46 with records porting the supplemental content. The data structure corre- 
containing information relating to available shows or pro- 10 lates the target specifications with the programs by associ- 
grams. ating them within the same program record. The presence of 

The headend 22 further includes an enhanced content a specification within the data field 58 indicates that 
server 52 which serves supplemental interactive content to ^ associated program is interactive and that complemen- 
the viewer computing units to enhance or supplement the tary content can be displayed in addition to the program 
continuous video streams served by the continuous media 15 ilself - ^ lar S et specification can be implemented in dif- 
server 42. The supplemental content is stored digitally in ferenl forms - Tn e tar S et specification to the supplemental 
database 54 and can be text, graphics, video, picture, sound, content slored al headend which enhances the "Murder, 
or other multimedia types. Examples of supplemental con- Snc Wrote" program is in the form of a pointer "CON- 
tent include trivia questions or games related to the program, TENT1." The presence of this pointer in field 58 indicates 
advertisements, merchandise or other memorabilia, hyper- 20 that the program "Murder, She Wrote" is interactive corn- 
links to similar programs of similar type or starring the same patible and that the supplemental content resides at a 
actor/actress, and so on. memory location identified by the pointer "CONTENT!." 

In the implementation described herein, the supplemental Similarly, the programs "Seinfeld" and "Star Trek" are 

content is constructed as a hypertext file which is rendered „ interactive : compatible and have associated supplemental 

by a browser. Hypertext, or hypermedia, is a metaphor for 25 conte J nt wh J ch a ' e * oc ** d ^ the ^ erb f URLs m COrre " 

presenting information in which text, images, sounds, and spondmg data field 58. TTiese tRU reference resources 

actions become linked together in a complex, non-sequential P r ™ de f d b ? independent service providers (described below 

web of associations that permit a user to browse through wtl1 reteren ce to FIG. 4). 

related topics, regardless of the presented order of the topics. A URL (universal resource locator) is a type of target 

Hypermedia content is widely used for navigation and specification used in WWW documents to describe every- 

information dissemination on the "World-Wide Web" thing about a particular resource that a browser needs to 

(WWW or Web) of the Internet. know to request and render it. The URL describes the 

Hypermedia content is commonly organized as docu- P rotoco J a browser should ™* to retrieve the resource, the 

ments with embedded control information. The embedded 35 nam * of the computer it is on, and the path and file name of 

control information includes formatting specifications, indi- lne resource - 

eating how a document is to be rendered by the browser. In The following is an example of a URL listed in the EPG 

addition, such control information can include links or data structure 48 in association with the "Seinfeld" program: 

"hyperlinks," which are symbols or instructions telling the ^ nbeco seiafeid 

browser where to find other related documents on the 4Q p ' cc0 s<a e 

Internet. A hyperlink includes a label, which is typically j^e «http://" portion of the URL describes the protocol, 

rendered as a graphical icon or as highlighted keywords, and j^e letters "http" stand for HyperText Transfer Protocol, the 

an underlying target specification. The target specification is set of tnat a browser will follow to request a document 

set forth in the underlying hypermedia document, but is and tne remote server will follow to supply the document, 

normally invisible to the user. The target specification unam- 45 "www.nbc.com" portion of the URL is the name of the 

biguously identifies a targeted document or resource, sped- remote host computer which maintains the document. The 

fying the name of the computer on which the document last port j on «/ sc infeld" is the path and file name of the 

resides and the complete file name of the document. document on the remote host computer. 

In concept, the target resource can be virtually aoy type of The development of the EPG data structure 48 includes 

object — including executable programs, text or multimedia 50 designating separate data fields 50 within a storage medium 

documents, sound clips, audio segments, still images, f or holding programming information, and dedicating at 

computers, directories, and other hyperlinks. In WWW least one of the data fields 58 to storing target specifications 

documents, hyperlink targets are most often files that can to supplemental content. The target specifications can be in 

reside on any computers connected to the Internet. However, the form of memory pointers, hyperlinks, URLs, or any 

a hyperlink target can also be a particular location within a 55 other designation for referencing a location containing 

document, including the document that is currently being supplemental content. For programs with no corresponding 

rendered. Hypertext usage is not limited to the Internet. supplemental content, the target specifications data field 58 

Various multimedia applications utilize hypertext to allow jg i c ft empty. However, for those programs with supplemen- 

users to navigate through different pieces of information tal content, the target specification to the target resource 

content. 60 containing the supplemental content is entered in the data 

FIG. 3 shows an example data structure 48 which is used field 58 and correlated with the program. The correlation is 

by the EPG database 46 to organize programming informa- provided through the data structure by placing the target 

lion and to correlate target specifications with the programs. specification within the same data record as the program title 

The data structure includes a number of data records com- and other information for a particular program. It is further 

prising various data fields 50 for holding programming 65 noted that the target resources can be embedded within other 

information. The data fields contain program titles, actor text-based data held in other data fields 50 which also relate 

names, whether the program has closed captioning or stereo to the corresponding programs. 
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The same or a subset of data structure 48 is employed at synchronized with the program using open loop control, 

the EPG application running at the viewer computing unit in such as a start time followed by measurable ticks or by frame 

the home. The data records stored at the headend on the EPG count. 

server are transmitted periodically in batch, or individually, FIG. 5 shows a viewer computing unit, referenced gen- 

and cached at the local EPG. The local EPG is thus able to s erally as numeral 90, in more detail. The viewer computing 

identify whether a particular program is interactive compat- unit 90 includes a processor 92, a volatile memory 94, and 

ible by quick reference to the locally cached EPG data a program memory 96. The viewer computing unit 90 also 

structure. has at least one receiver, and possibly two receivers, for 

FIG. 4 shows an interactive entertainment system 60 receiving the video stream from a the headend and the digital 
according to a second implementation which accommodates 10 supplemental data from the headend or ISP. The first 
third party independent service providers. Interactive enter- receiver is in the form of a tuner 98 which tunes to the 
tainment system 60 includes headend 22 which supplies channel or broadcast frequency to receive a video data 
programs and supplemental content to a viewer computing stream from a program source, such as the headend, 
unit 62. In this implementation, the viewer computing unit broadcaster, or other program provider. The second receiver, 
62 is implemented as a computer 64 with a monitor 66, a is referenced generally as 100, can be implemented as a second 
central processing unit 68, a keyboard 70, and a mouse 72 tuner for receiving the content over a cable or wireless 
(although other input devices can be used in addition to, or distribution network, or a modem for receiving the supple- 
instead of, the keyboard and mouse). mental content over the Internet or other data network. 

The headend 22 serves the programs over a first network The viewer computer runs an operating system 101 which 

74, which may be implemented like the fiber optic distri- 20 supports multiple applications. The operating system 101 is 

bution structure described above, or as a satellite system or stored in memory and executes on the processor. The 

other wireless broadcast system, or as a conventional data operating system is preferably a multitasking operating 

network. It is noted that other program providers may be system which allows simultaneous execution of multiple 

used instead of a headend, such as a broadcast station or an applications. The operating system 101 employs a graphical 

online service provider. 25 user interface windowing environment which presents the 

The interactive entertainment system 60 also includes applications or documents in specially delineated areas of 

multiple independent service providers (ISPs), as repre- the display screen called "windows." One preferred operat- 

sented by ISP 80, which distribute digital content to the ing system is a Windows® brand operating system sold by 

viewer computing unit 62 over a second network 82. An Microsoft Corporation, such as Windows® 95 or Windows® 

example of the second network 82 is a public network, such 30 NT or other derivative versions of Windows®. However, 

as the Internet. The ISP 80 has a host 84 and a content other operating systems which provide windowing environ- 

database 86 to serve various multimedia content to the ments may be employed, such as the Macintosh operating 

viewer's computer. The ISP host 84 stores one or more target system from Apple Corporation and the OS/2 operating 

resources that can be rendered by the viewer computing unit system from IBM. 

62. 35 A channel navigator application 102 is stored in program 

The supplemental content provided by the ISP 80 is memory 96 and executes on the processor 92 to control the 

correlated with the programs by data structure 48 as tuners 98 and 100 to select a desired channel for receiving 

described above. As shown in FIG. 3, the data field 58 the video content programs. An EPG application 104 is 

includes target specifications to supplemental content pro- stored in program memory 96 and executes on the processor 

vided by servers other than the program provider which 40 92 to organize programming information downloaded from 

distributes the show. In the illustrated example, the programs the EPG server at the headend. The EPG 104 supports a 

Seinfeld and Star Trek have associated ISP-served content displayable user interface (UI) which visually correlates 

which are located by the hyperlink URLs in corresponding programs titles to scheduled viewing times and tuning 

data field 58. It is further noted that a program might have information, such as a channel, in a scrollable grid format, 

more than one source of supplemental content. The program 45 The viewer computing unit 90 also has an interactive 

record for "Star Trek" has two associated target support module in the form of browser 106 which is kept in 

specifications, one that references a target resource at the memory 96. The browser 106 is dynamically loaded on 

host computer "www.fox.com" and one that references a processor 92 when needed to render content, such as a 

target resource at the host computer "www.collection- hypertext document, from an ISP or other content provider, 

s.com." 50 The browser can be implemented as a hyperlink browser, or 

According to this FIG. 4 arrangement, the viewer com- more particularly, as an Internet Web browser, 
puting unit 62 receives a non-interactive, continuous video Although not shown, the viewer computer might also 
stream from the headend 22, and supplemental interactive include one or more storage drives, such as a CD-ROM 
content from either the headend 22 or from an independent drive, to play interactive CD-ROMs in the event that supple- 
service provider 80. The supplemental content might there- 55 mental data is supplied locally on disk, 
fore be carried to the viewer's computer over the same FIGS. 6 and 7 show a method for operating an interactive 
channel as the program, over a separate channel, or over a entertainment system to enhance a conventional continuous 
separate connection unrelated to the program channels. The video data stream, such as a television show, with interactive 
back channel for facilitating interactive control is provided supplemental content. This method is described with addi- 
through either network 74 or 82 . 60 tional reference to the screen displays shown in FIGS. 

In another implementation, the interactive content can be 8a-8c. 

supplied locally by a storage medium, such as a CD-ROM. The method begins when a viewer tunes to a particular 

Suppose, for example, a content developer creates an inter- channel (step 150 in FIG. 6). The channel navigator 102 

active CD-ROM that can be played along with a particular controls the tuner 98 to tune to the channel. The viewer 

movie. The supplemental content is accessed via disk reads 65 computing unit checks the appropriate channel and time slot 

to the local storage drive, rather than using URLs to target of the EPG data structure 48 to determine if the program 

resources over a network. The supplemental content is being carried on the selected channel at this time is inter- 
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active (step 152). As described above, the presence of a video content program. The digital data defines the supple - 

target specification in the EPG data field 58 in association mental content to enable viewer interactivity with the video 

with the program is an indication that the program is content program. The digital data also defines a display 

interactive compatible and that there is supplemental content layout prescribing how the supplemental content and the 

for the program. If the data field is empty, indicating that no 5 video program are to appear in relation to one another when 

supplemental content exists (i.e., the "no" branch from step displayed on the screen. 

154), the viewer computing unit simply displays the video dala defines timing information to 

data stream being received through the tuner 98 (step 156). synchronizc presentation of the supplemental content with 

A run-time technique can alternatively be used for detect- me ^ conteQt program . ^ information can be 

mg whether a program is mteracUve compaUble. Ramer than w ^ lcmcntcd ^ many mwni ways . 0 ne approach is to 

checking the EPG data field, the viewer computing unit r . , . . . /. 1 

l 1 j j- „ j l ir .L -* r 1 coordinate the supplemental content to a particular program 

checks a dedicated channel for the existence of new supple- A . , A , rr . „ c_ A. * . . 

mental content data. The dedicated channel is separate from start Ume ' " d * cn carefuU y me ^ re tln * from ^ start 

the selected channel carrying the program so that the supple- Umc to synchronize presentation of the supplemental content 

mental content is received by the viewer computing unit Wlth the appropriate points in the program. Another 

currently with the program video data. The existence of a 15 approach is to characterize the program in terms of frames, 

supplemental content data stream over the dedicated channel and ke y the introduction of supplemental content to the 

indicates that the program beiog received on the selected frame numbers. 

channel is interactive compatible. This technique can be The video stream and supplemental content can be trans- 
carried out without reference to the EPG listing. mitted together, as a single signal, or separately. In the 

If the program is interactive compatible (i.e., the "yes" 20 former implementation, the digital data is packaged with the 

branch from step 154), the viewer computing unit retrieves video stream and transmitted as one signal from the head- 

the target specification from the EPG data structure (step 158 end. The viewer computing unit receives the single signal at 

in FIG. 6). The target specification might be a pointer to a tuner 98 and separates the digital data from the video signal 

memory location at the headend, or a pointer to a memory (steps 172 and 174). In the latter implementation, the video 

location on a locally running CD-ROM, or a hyperlink to a 25 data stream is received over the selected channel via tuner 98 

target resource located at an independent service provider. from the program provider (step 172). The digital data is 

The hyperlink browser 106 is loaded onto the processor to received from the target resource that is activated by the 

render the target resource referenced by the target specifi- browser (step 174). This target resource might be located at 

cation (step 160). the headend, in which case, the data is received over a 

At mis point, there are several ways to initiate viewing the 30 separate channel using tuner 100; or the target resource 

supplemental content. One approach is to permit the viewer might be served by an independent service provider, in 

to selectively activate the interactive mode (i.e., the "viewer which case, the data is received over a public network using 

activate" branch from step 160). The viewer may know that the modem 100. 

the program is interactive compatible by checking a news- At the viewer computing unit, the digital data is decon- 
paper listing or other program guide. Another way is to have 35 structed to extract the timing information and the display 
the viewer computing unit display an icon or other indicia on layout from the supplemental content (step 176 in FIG. 6 and 
the screen to visually inform the viewer that the program is step 178 in FIG. 7). The display layout defines a program 
interactive compatible (step 162 in FIG. 6). The icon can be boundary within which the program is displayed to the 
overlaid on the playing video program in a non-conspicuous viewer. The program boundary is sized and shaped accord- 
manner, like the closed caption or stereo labels. 40 ing to parameters prescribed in the display layout. As the 
FIG. 8a shows an example screen 200 having a video size and shape changes, the processor scales the video data 
program 202 playing at full-size on the screen. An icon 204 for display within the program boundary at that instance 
is displayed at the lower right corner of the screen to inform (step 180 in FIG. 7). 

the viewer that the program 202 is interactive compatible. The display layout also defines how the supplemental 

The icon 204 can be displayed throughout the program, or 45 content is illustrated along with the program. The display 

faded out after a set time period. This initial screen repre- layout prescribes the size, style, location, and other param- 

sents a first mode of interactivity, where the viewer is eters for presenting the supplemental content. For instance, 

presented with the choice of interactive entertainment or the supplemental content might be at least partly overlaid on 

non-interactive viewing of the program. As long as the the video program, or provided as a wrapper around, or 

viewer does not activate the icon 204, the viewer computing 50 along side, the program. The supplemental content is dis- 

unit continues to receive the video content program over the played according to this display layout and synchronized to 

selected channel and display that program alone, without the program according to the timing information (step 182 in 

any supplemental content (steps 166 and 168 in FIG. 6). FIG. 7). As an example, the supplemental content might be 

If the viewer decides to enter into an interactive mode, the a trivia game which quizzes the viewer as to possible 

viewer employs a remote control handset, mouse, keyboard, 55 outcomes of various scenes. The questions are displayed on 

or other mechanism to actuate the icon 204. This causes the the screen according to the display layout and are timed 

browser 106 to start the target resource located by the target using the timing information to coincide with the part of the 

specification listed in the EPG data structure (step 170 via program to which the questions pertain, 

the "yes" branch from step 164). FIG. Sb illustrates a screen 200 that is part of the 

This leads to another approach to invoking the supple- 60 interactive mode. Here, the video program is constrained 

mental content. Rather than displaying an icon and waiting within a program boundary 210 which is less than flu 11- 

for input from the viewer, the viewer computing unit can screen size. The program boundary 210 has been reduced in 

automatically activate the target resource as soon as the comparison to the full-size presentation of FIG. 8a to make 

browser is loaded on the processor (step 170 from the room for the supplemental content In this illustration, the 

"automatic" branch from step 160). 65 supplemental content consists of a main menu having soft 

The target resource contains digital dala which supports buttons 212-221, a highlighter or cursor icon 224, graphics 

interactive functionality in conjunction with the associated bars 226, and a text block 228 to hold the program title. The 
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soft buttons 212-221 present various control options to the mode of interactivity. The main menu is still present on the 

viewer to invite interactive involvement with the program. screen, but more contextual information is added in a 

The illustrated screen is taken from an interactive pro- graphical format to represent an extension of the selected 

gram based on a Star Trek episode. To provide an example soft button 220. The program boundary 210 is further 

of the main menu, the soft buttons 212-216 represent actions s reduced to accommodate the additional graphical and textual 

for calling up related TV shows and movies. For instance, information. 

button 212 relates to the original Star Trek series; button 213 In this illustration, the viewer has selected the entertain- 

concerns The Next Generation series; button 214 represents ment button 220 to display the merchandise store. This 

the Deep Space Nine series; button 215 represents the layout places the video program box 210 in the lower right 

Voyager series; and button 216 relates to the various motion 10 hand corner of the screen, and leaves the remaining area of 

pictures. the screen to be used for supplemental content. The supple - 

Soft button 217 is an access/classified toggle which mental content comprises a secondary menu having actuat- 
allows selection of one of two levels of interactivity. able soft buttons 232-237. The cursor symbol 224 is mov- 
" Access" serves as a default mode of interactivity which able among the various buttons and used to activate a 
contains the main menu functionality. The screen of FIG. Sb 35 selected button. The buttons correspond to various types of 
is an example of the access mode of interactivity. A voice- merchandise, such as clothes, posters, collectibles, 
over narrative announces the mode when selected by button memorabilia, and toys. There is also an order button 237 that 
217. Once in the access mode, the broadcast video stream is permits the user to place an order for a particular product. A 
shrunk to fit within the smaller program boundary 210 to picture window 240 is arranged beside the secondary menu 
accommodate the main menu graphics. The alternate mode 20 to show a picture of the merchandise associated with the 
of interactivity, or "classified" mode, contains time-linked category indicated by the cursor symbol 224. A merchandise 
contextual information to provide a second tier of informa- description window 242 contains a brief description of the 
tion. FIG. 8c, shown below, is an example of the classified merchandise shown in the picture window 240. 
mode of interactivity. The system and method for presenting interactive enter- 
Soft buttons 218-220 enable selection of different types 25 tainment programs is advantageous as it returns the freedom 
of supplemental content. Button 218 relates to an encyclo- of creativity to the content developer. By embedding the 
pedia containing numerous facts and information about the display layout instructions within the digital data provided 
program. In the Star Trek program, for example, the ency- by a target resource, the developer is empowered to create 
clopedia might contain information on aliens, behind-the- both the content and the presentation format of how the 
scenes tidbits, cast and crew biographies, facts on other 30 content and broadcast program are displayed to the viewer, 
episodes, interviews with the actors/actresses, a technical The developer is free to control the location and shape of the 
manual explaining intricacies of starship operation and broadcast program window, as well as the presentation 
travel, and various timelines. format of the supplemental content relative to the program 

Button 219 is associated with a program guide, which window. This facilitates a non-restrictive environment in 

provides a listing of current Star Trek shows for a two week 35 which the developer can create screens with optimal appeal 

period. The program guide also permits the user to change to the viewer. No longer is the developer simply developing 

channels to another channel carrying a Star Trek show, if content to be displayed within a fixed pane that cannot be 

available. dynamically altered relative to the program. 

Button 220 allows selection of entertainment content, The creative power is thus placed in the hands of the target 

which includes trivia games related to the program and a 40 resource author. FIG. 9 shows a method for authoring an 

merchandise catalog. The trivia games segment allows interactive entertainment program. The author begins by 

viewers to compete against other regional competitors. The developing the supplemental content which is to accompany 

catalog lists available merchandise related to the program a particular television show or movie (step 250 in FIG. 9). 

that can be purchased by the viewer. The author designs the presentation format for each scene of 

The tenth button 221 is a quit button which allows the 45 the program (step 252), and the timing requirements for 

viewer to leave the interactive mode and return to a full- synchronizing the supplemental content with the broadcast 

screen display, as shown in FIG. 8a. video stream (step 254). 

The program and supplemental content are displayed as In the implementation described herein, the supplemental 

prescribed by the display layout. The digital data from the content is constructed as a hypertext document which can be 

target resource, however, can dynamically change the dis- 50 rendered by a browser. To control how the content is to be 

play layout. When the display layout is changed (i.e., the rendered, the author encodes the presentation format and 

"yes" branch from step 184), the viewer computing unit timing instructions as extension attributes to hyperlink 

re-sizes and/or reshapes the program boundary 210 and codes. More specifically, hypermedia content utilized by the 

location of the supplemental content to achieve the presen- WWW is commonly written using what is referred to as a 

tation envisioned by the content developer (step 186). The 55 "markup language." "SGML" (Standard Generalized 

display layout can be changed for various reasons. The Markup Language) is one such language, defined formally 

display layout might change in response to viewer selection as "a language for document representation that formalizes 

of a soft button, as is the case causing the display layout markup and frees it of system and processing dependen- 

change between FIGS. &b and 8c. The display layout might cies " SGML is a language for describing the structure of 

also be altered automatically as part of the liming informa- 60 documents and for describing a tagging scheme to delineate 

tion. For instance, the digital data might invoke a graphic or that structure within text. For creating hypermedia content, 

text to pop up on the screen at a timely point in the program. WWW documents utilize a subset of SGNL called "HTML" 

Such real-time content includes, for example, trivia (Hypertext Markup Language). An HTML textual document 

questions, interesting facts, graphical or sound effects, and can be thought of as plain text that contains formatting 

so forth that relate to specific parts of the program. 65 instructions in the form of HTML markup codes or "tags," 

FIG. 8c shows the screen 200 at another instance after the Tags tell Web browsers how to render and print documents, 

viewer has selected soft button 220 to enter into a classified and are also used to specify hyperlinks. 
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The following is a simple example of a start lag for an 
HTML hyperlink: 

<A HREF»"ht^7/wwwjnicnBoftooinftipgrades''> 

The leading "A" in the start tag is the name of HTML 
element. The letter "A" indicates that the tag is an "anchor" 
tag — the type of tag that defines a hyperlink. The start tag 
contains an "attribute" indicating a target specification: 

HREF«»"http://wwwjnicroso ft com/upgrades". 

The attribute name is "HREF' and the attribute value is 
"http://www.microsofLcom/upgrades." HTML documents 
arc organized according to various tags. Tags define the start 
and end of headings, paragraphs, lists, character highlighting 
and links, and so on. 

The interactive entertainment system described herein 
supports conventional HTML documents as target resources. 
Accordingly, authors can use familiar HTJL elements, such 
as Head, Body, and Character- Level elements, to construct 
a target resource. However, the inventors have also devel- 
oped new types of tags, as well as extension attributes to 
existing HTUL tags. The author of a target resource can use 
the new tags and extension attributes to formulate how and 
when the browser renders the supplemental content along 
with the continuous video stream. The new HTUL extension 
attributes are given below in Table 1. 

TABLE 1 

HTML Extension Attributes 

Extension 
HTML Tag Attribute Function 



BODY 



IMG 



back- 
ground 

dynsrc 



FRAMESET usedefault 



Specifies a URL for an image tile or MMS 
stream to cover the document background to 
yield a distinctive appearance. 
Specifies the address of a video clip or 
broadcast source to be displayed. 
Used to determine where the focus is located in 
a tab-based user interface within a FRAME by 
specifying the URL for the file containing the 
map, followed by a '#', followed by the 
name of the USEDEFAULT. If the argument to 
USEDEFAULT starts with a *#*, the map is 
assumed to be in the same document as the 
USEDEFAULT tag 



The new tags supported by the interactive entertainment 
system are provided in Table 2. 



TABLE 2 



HTML Tags 



HTML Tag 



Function 



Permitted Attributes 



ACTION Controls update or CELL — identifies object in a 

display of sound or GALLERY 
picture HREF — URL to resource or 
object 

ID — tabel or id for this 
element 

TARGET — where to perform 
action such as a FRAME or 
RENDERI MAGE element 
EVENT Associates trigger and TRIGGER-refercnce to 

action TRIGGER element to be used 

with this event 
ACnON-reference to 
TRIGGER element to be used 
with this event - allow 
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TABLE 2-continucd 



HTML Tags 



HTML Tag 



Function 



Permitted Attributes 



10 



GALLERY 



Stores and coordinates 
collection of images 



15 



LOADFONT Downloads and installs 
a font to be used 

RENDERIMAGE Displays an image 
from the GALLERY 



TRANSITION 



25 



TRIGGER 



Defines screen change 
interim, fade to black, 
cut, and so on. 



Defines when 
something is to occur 



comment delimited list of 
actions to satisfy the need 
for multiple actions in 
response to a single trigger 
ID — name of event 
SOURCE— URL to actual 
graphic 

ID— name of gallery 
ROWS — height of each 
graphic cell 

COLUMNS — width of each 
graphic cell 

TRANSPARENCY— RGB 
value indicating background 
color 

HREF - URL to font resource 

REF — name of GALLERY 
CELL — specifies individual 
cells containing image 
TYPE -type of transition 
SPEED — how fast does the 
transition occur, SLOWEST, 
SLOW, MEDIUM, FAST, 
FASTEST 

ID — name of this TRIGGER 
TIME — time in milliseconds 
since the last event 



30 



Using the supplemental content and HTML tags for 
timing and presentation format, the author constructs the 
target resource (step 256 in FIG. 9), The target resource is 
stored in a storage medium at a host computer and a target 
specification for referencing that location is defined (step 
258). The author submits the target specification to the 
authority responsible for developing the programming infor- 
mation maintained in the EPG database. The target specifi- 
cation is stored in the appropriate data field of the EPG data 
structure which corresponds to the program to which it 
pertains (step 260). 

In compliance with the statute, the invention has been 
described in language more or less specific as to structure 
and method features. It is to be understood, however, that the 
invention is not limited to the specific features described, 
since the means herein disclosed comprise exemplary forms 
of putting the invention into effect. The invention is, 
therefore, claimed in any of its forms or modifications within 
the proper scope of the appended claims appropriately 
interpreted in accordance with the doctrine of equivalents 
and other applicable judicial doctrines. 

What is claimed is: 

1. A viewer computing unit for receiving and displaying 
continuous video content programs, comprising: 
a memory; 

a processor programmed to determine whether the video 

content programs are interactive; 
a tuner to tune to channels carrying the video content 

programs; 

an Internet browser stored in the memory, the Internet 
browser being dynamically loadable for execution on 
the processor when the tuner is tuned to a channel 
carrying a video content program that is interactive; 

an electronic programming guide (EPG) stored in the 
memory and executable on the processor to organize 
programming information, the EPG associating a target 
specification to a target resource with a video content 
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program, the target resource containing supplemental 
content which is displayed concurrently with the video 
content program to provide viewer interactivity with 
the video content program and display layout instruc- 
tions prescribing how the 

supplemental content and the video content program are 
to appear in relation to one another when displayed; 

the Internet browser activating the target resource when 
the tuner is tuned to the video content program; and 

the processor being responsive to the layout instructions 
obtained from the target resource to display the stipple - 
mental content concurrently with the video content 
program. 

2. A viewer computing unit as recited in claim 1, further 
comprising: 

a receiver coupled to the processor to receive both the 
video content program and the supplemental content 
supplied from the target resource. 

3. A viewer computing unit as recited in claim 1, further 
comprising: 

a first receiver coupled to the processor to receive the 

video content program; and 
a second receiver coupled to the processor to receive the 

supplemental content supplied from the target resource. 

4. A method for enhancing a continuous video content 
program with supplemental hyperlink content to provide 
viewer interactivity with the video content program com- 
prising the following steps: 

configuring digital data which defines a display layout 
prescribing how the supplemental hyperlink content 
and the video content program are to appear in relation 
to one another when displayed; 

transmitting the digital data along with the video content 
program as two separate signals to a viewer computing 
unit; 

receiving a first signal containing the digital data using a 
first receiver at the viewer computing unit; 

receiving a second signal containing the video content 
program using a second receiver at the viewer com- 
puting unit; and 

displaying the supplemental hyperlink content and the 
video content program according to the display layout. 

5. A computer-implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 

receiving the video content program over the channel; 

receiving the digital data from the target resource; and 
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displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource. 

6. A computer-implemented method as recited in claim 5, 
further comprising the following steps: 

correlating the target specifications with associated pro- 
grams in an electronic program guide (EPO); and 

checking the EPG to ascertain whether the program is 
interactive compatible; and 

determining that the program is interactive compatible by 
presence of a target specification in the EPG which is 
related to the program. 

7. A computer-implemented method as recited in claim 5, 
further comprising the step of automatically displaying the 
supplement content together with the video content pro- 
gram. 

8. A computer-implemented method as recited in claim 5, 
further comprising the step of overlaying the supplemental 
content at least partly on the video content program. 

9. A computer-implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 

receiving the video content program over the channel; 

receiving the digital data from the target resource; 

displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource; 

displaying the video content program within a program 
boundary on a visual display screen; 

presenting the supplemental content in a presentation 
format on the visual display screen; and 

controlling location and shape of the program boundary 
and the presentation format of the supplemental content 
relative to the program boundary according to the 
display layout received from the target resource. 

10. A computer- implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
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target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 

receiving the video content program over the channel; 

receiving the digital data from the target resource; 

displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource; and 

synchronizing presentation of the supplemental content to 
corresponding points in the video content program. 

11. A computer- implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 

receiving the video content program over the channel 
from a first source; 

receiving the digital data from the target resource at a 
second source different than the first source; and 

displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource. 

12. A computer-implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed, the digital data further defining timing 
information to synchronize presentation of the supple- 
mental content with the video content program; 
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receiving the video content program over the channel; 

receiving the digital data from the target resource; 

displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource; and 

displaying the supplemental content at prescribed times 
during the video content according to the timing infor- 
mation received from the target resource. 

13. A computer-implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

displaying an icon to visually inform the viewer that the 
program is interactive compatible; 

launching an Internet browser to activate a target resource 
located by the target specification, the target resource 
containing digital data which supports interactive func- 
tionality in conjunction with the associated video con- 
tent program, the digital data defining supplemental 
content to enable viewer interactivity with the video 
content program and a display layout prescribing how 
the supplemental content and the video content pro- 
gram are to appear in relation to one another when 
displayed; 

receiving the video content program over the channel; 
receiving the digital data from the target resource; and 
displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource. 

14. A computer-implemented method as recited in claim 
13, further comprising the step of displaying the supplement 
content in response to the viewer activating the icon. 

15. A computer- implemented method comprising the fol- 
lowing steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

is in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource is located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
ciated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing bow the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 

receiving the video content program over the channel; 

receiving the digital data from the target resource; 

displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource; and 

presenting the supplemental content in an area surround- 
ing the video content program. 
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16. A computer programmed to perform the following 
steps: 

tuning to a channel; 

determining if a video content program being carried on 
the channel is interactive compatible as indicated by 
presence of a target specification provided in associa- 
tion with the video content program; 

in an event that the program is interactive compatible, 
retrieving the target specification associated with the 
video content program on the channel; 

dynamically launching an Internet browser to activate a 
target resource located by the target specification, the 
target resource containing digital data which supports 
interactive functionality in conjunction with the asso- 
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dated video content program, the digital data defining 
supplemental content to enable viewer interactivity 
with the video content program and a display layout 
prescribing how the supplemental content and the video 
content program are to appear in relation to one another 
when displayed; 
receiving the video content program over the channel; 
receiving the digital data from the target resource; and 
displaying the video content program and the supplemen- 
tal content according to the display layout prescribed in 
the digital data received from the target resource. 
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